A Bellman Approach for Regional Optimal Control Problems in RN

نویسندگان

  • Guy Barles
  • Ariela Briani
  • Emmanuel Chasseigne
چکیده

This article is a continuation of a previous work where we studied infinite horizon control problems for which the dynamic, running cost and control space may be different in two halfspaces of some euclidian space R . In this article we extend our results in several directions: (i) to more general domains; (ii) by considering finite horizon control problems; (iii) by weaken the controlability assumptions. We use a Bellman approach and our main results are to identify the right Hamilton-Jacobi-Bellman Equation (and in particular the right conditions to be put on the interfaces separating the regions where the dynamic and running cost are different) and to provide the maximal and minimal solutions, as well as conditions for uniqueness. We also provide stability results for such equations. Key-words: Optimal control, discontinuous dynamic, Bellman Equation, viscosity solutions. AMS Class. No: 49L20, 49L25, 35F21.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Solving The Optimal Control Problems Using Homotopy Perturbation Transform Method

Inthispaper,wesolveHamilton-Jocobi-Bellman(HJB)equationsarisinginoptimalcontrolproblems usingHomotopyPerturbationTransformMethod(HPTM).Theproposedmethodisacombinedform oftheLaplaceTransformationMethodwiththeHomotopyPerturbationMethodtoproduceahighly effectivemethodtohandlemanyproblems. ApplyingtheHPTM,solutionprocedurebecomeseasier, simplerandmorestraightforward. Someillustrativeexamplesaregive...

متن کامل

Friction Compensation for Dynamic and Static Models Using Nonlinear Adaptive Optimal Technique

Friction is a nonlinear phenomenon which has destructive effects on performance of control systems. To obviate these effects, friction compensation is an effectual solution. In this paper, an adaptive technique is proposed in order to eliminate limit cycles as one of the undesired behaviors due to presence of friction in control systems which happen frequently. The proposed approach works for n...

متن کامل

Feedback controller design for linear and a class of nonlinear optimal control problems

This paper presents a feedback controller designing approach for a large class of finite-time optimal control problems. This approach involves a piecewise truncated variational iteration method (PTVIM) for solving the nonlinear Hamilton–Jacobi–Bellman equation. By using the finite iterations of PTVIM, an analytic approximate solution for value function and suboptimal feedback control law is obt...

متن کامل

Manifold Representations for Continuous-State Reinforcement Learning

Reinforcement learning (RL) has shown itself to be an effective paradigm for solving optimal control problems with a finite number of states. Generalizing RL techniques to problems with a continuous state space has proven a difficult task. We present an approach to modeling the RL value function using a manifold representation. By explicitly modeling the topology of the value function domain, t...

متن کامل

A Numerical Approach for Fractional Optimal Control Problems by Using Ritz Approximation

In this article, Ritz approximation have been employed to obtain the numerical solutions of a class of the fractional optimal control problems based on the Caputo fractional derivative. Using polynomial basis functions, we obtain a system of nonlinear algebraic equations. This nonlinear system of equation is solved and the coefficients of basis polynomial are derived. The convergence of the num...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • SIAM J. Control and Optimization

دوره 52  شماره 

صفحات  -

تاریخ انتشار 2014